In the Claims 



1. (Currently amended) A computerized method executable bv an audio visual 
information system, the method comprising: 

writin g a data structure representing a description scheme for a multimedia 
sequence to a data store for subsequently querying the multimedia sequence, the- a 
description scheme containing relations corresponding to relationships between entities in 
a-the multimedia sequence , wherein the data structure comprises a graph having a set of 
vertices representing the entities and a set of edges representing the relations ; 

determining the relations for representation by parameters to define fuzzy 
relationships, each parameter having numerical values representing confidence in the 
corresponding fuzzy relationship; 

obtaining at least one of 

a numerical value for each parameter, 

a description of the parameter containing a numerical value, and 
a description capable of setting the parameter dynamically; and 
modifying the numerical values representing the confidence in response to 
changes in the parameter as the multimedia sequence progresses , the numerical values 
calculated using a membership function mn(x) = g o ffx)* where R is the set of edges 
over the set of vertices A x B*2 defines a function for the parameter over a parameter 
space PS. and /is a parameterization function/ :AxB^> PS. g : PS . 

2. (Previously presented) The method of claim 1 further comprising: 

combining an MPEG7 State DS (description scheme) with an additional field in 
an MPEG7 GraphType DS. 

3. (Cancelled) 

4. (Currently amended) The method of claim 1 further comprising: 

running, by a user, a quer y on the data structure based on membership of an entity 
in one of the relations. 
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5. (Previously presented) A computer-readable medium having executable instructions to 
cause a computer to perform a method comprising: 

writin g a data structure representing a description scheme for a audio visual 
sequence to a data store for subsequently querying the audio visual sequence, the a 
description scheme containing relations corresponding to relationships between entities in 
an -the audio visual sequence , wherein the data structure comprises a graph having a set 
of vertices representing the entities and a set of edges representing the relations ; 

determining the relations for representation by parameters to define fuzzy 
relationships, each parameter having numerical values representing confidence in the 
corresponding fuzzy relationship; 

obtaining for each parameter at least one of 
a numerical value, 

a description of the parameter containing a numerical value, and 
a description capable of setting the parameter dynamically; and 
modifying the numerical values representing the confidence in response to 
changes in the parameter as the multimedia sequence progresses , the numerical values 
calculated using a membership function mn(x) =go ffx), where R is the set of edges 
over the set of vertices A X B % g defines a function for the parameter over a parameter 
space PS, and /is a parameterization function/ :AxB^> PS, g : PS . 

6. (Previously presented) The computer-readable medium of claim 5, wherein the method 
further comprises: 

combining an MPEG7 State DS (description scheme) with an additional field in 
an MPEG7 GraphType DS. 

7. (Cancelled) 

8. (Currently amended) The computer-readable medium of claim 5, wherein the method 
further comprises: 
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performing a query on the data structure b ased on membership of an entity in one 
of the relations. 

9. (Currently amended) A computerized method executable by an audio video 
information system, the method comprising: 

deriving a confidence value for a fuzzy relation from a parameter associated with 
one of a plurality of description schemes in a content description fog -representing a 
multimedia sequence, the confidence value representing a degree to which the fuzzy 
relation is a member of a subset of relations among the description schemes; 

associating the description schemes with a set of vertices in a graph and the subset 
of relations with a set of edges among the set of vertices, wherein the graph is written to a 
data store for subsequently querying the multimedia sequence; and 

modifying the confidence value in response to changes in the parameter as the 
multimedia sequence progresses , the confidence value calculated using a membership 
function mpfx) =go f(x), where R is the set of edges over the set of vertices A x B*2 
defines a function for the parameter over a parameter space PS, and fis a 
parameterization function f :AxB^> PS. g : PS: , 

10. (Previously presented) The method of claim 9, wherein the parameter is an attribute 
value. 

11. (Previously amended) The method of claim 9, wherein the confidence value is further 
derived from a set of parameters associated with the description schemes. 

12. (Cancelled) 

13. (Previously presented) The method of claim 9, wherein the description schemes 
represent entities in the multimedia sequence, the fuzzy relation represents a relationship 
between the entities, and the confidence value represents a state of the relationship. 
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14. (Previously presented) The method of claim 13, wherein the state of the relationship 
is described by a state description scheme that specifies the parameter. 

15-16. (Cancelled) 

17. (Currently amended) The method of claim 4^-9_further comprising: 

writing the graph without the edge representing the fuzzy relation if the 
confidence value is zero. 

18. (Previously amended) A computer-readable medium having executable instruction to 
cause a computer to perform a method comprising: 

deriving a confidence value for a fuzzy relation between description schemes from 
a parameter associated with one of the description schemes, the confidence value 
representing a degree to which the fuzzy relation is a member of a subset of relations 
among the description schemes in a content description fefr -representing a multimedia 
sequence; 

associating the description schemes with a set of vertices in a graph and the subset 
of relations with a set of edges among the set of vertices, wherein the graph is written to a 
data store for subsequently querying the multimedia sequence; and 

modifying the confidence value in response to changes in the parameter as the 
multimedia sequence progresses , the confidence value calculated using a membership 
function mn(x) = jg o f(x), where R is the set of edges over the set of vertices A x B,g 
defines a function for the parameter over a parameter space PS, and / is a 
parameterization function/ :AxB^> PS. g : PS , 

19. (Previously presented) The computer-readable medium of claim 18, wherein the 
parameter is an attribute value. 

20. (Currently amended) The computer-readable medium of claim 18, wherein the 
confidence value is further derived from a set of parameters associated with the 
description schemes. 
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21. (Cancelled) 



22. (Currently amended) The computer-readable medium of claim 18, wherein the 
description schemes represent entities in the multimedia sequence, the fuzzy relation 
represents a relationship between the entities, and the confidence value represents a state 
of the relationship. 

23. (Previously presented) The computer-readable medium of claim 22, wherein the state 
of the relationship is described by a state description scheme that specifies the parameter. 

24-25. (Cancelled) 

26. (Currently amended) The computer-readable medium of claim 2418, wherein the 
method further comprises: 

writing the graph without the edge representing the fuzzy relation if the 
confidence value is zero. 
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